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SIGNAL PROCESSING APPARATUS AND METHOD 

Background and Field of the Invention 

5 This invention relates to a method of signal processing and 
apparatus therefor . 

In many situations, observations are made of the output of a 
multiple input and multiple output system such as phase array 

10 radar system, sonar array system or microphone array system, 
from which it is desired to recover the wanted signal alone 
with all the unwanted signals, including noise, cancelled or 
suppressed. For example, in a microphone array system for a 
speech recognition application, the objective is to enhance 

15 the target speech signal in the presence of background noise 
and competing speakers. 

The most widely used approach to noise or interference 
cancellation in a multiple channel case was suggested by 

20 Widrow etc in w Adaptive Antenna Systems" Proc. IEEE, Vol.55 
No. 12, Dec. 1967 and "Signal Cancellation Phenomena in 
Antennas: causes and cures", IEEE Trans. Antennas Propag., 
Vol.AP30, May 1982. Also by L.J.Griffiths etc in w An 
Alternative Approach to Linearly Constrained Adaptive 

25 Beamf orming" . IEEE Trans. Antennas Propag. VolAP30, 1982. In 
these and other similar approaches, the signal processing 
apparatus separates the observed signal into a primary 
channel which comprises both the target signal and the 
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interference signal and noise, and a secondary channel which 
comprises interference signal and noise alone. The 
interference signals and noise in the primary channel are 
estimated using an adaptive filter having the secondary 
5 channel signal as input, the estimated interference and noise 
signal being subtracted from the primary channel to obtain 
the desired target signal. 

There are two major drawbacks of the above approaches. The 
10 first is that it is assumed that the secondary channel 
comprises interference signals and noise only. This 
assumption may not be correct in practice due to leakage of 
wanted signals into the secondary channel due to hardware 
imperfections and limited array dimension. The second is 
15 that it is assumed that the interference signals and noise 
can be estimated accurately from the secondary channel. This 
assumption may also not be correct in practice because this 
will required a large number of degrees of freedom, this 
implying a very long filter and large array dimension. A very 
20 long filter leads to other problems such as rate of 
convergence and instability. 

The first drawback will lead to signal cancellation. This 
degrades the performance of the apparatus. Depending on the 
25 input signal power, this degradation may be severe, leading 
to poor quality of the reconstructed speech because a portion 
of the desired signal is also cancelled by the filtering 
process. The second drawback will lead to poor interference 
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and noise cancellation especially low frequency interference 
signals the wavelengths of which are many times the dimension 
of the array. 

5 It is an object of the invention to provide an improved 
signal processing apparatus and method. 

Summary of the Invention 

10 According to the invention in a first aspect, there *is 
provided: signal processing apparatus comprising: 

1) an array of sensors, each for receiving signals; 

2) means for sampling and digitally converting the 
received signals/and 

15 3 ) a digital processor for processing the digitally 

converted signals to provide an output signal, the 
processor having a first adaptive filter for enhancing 
the signals and a second adaptive filter for suppressing 
the signals, the operation of the filters being 

20 controllable such that the first filter is operable to 

perform adaptive filtering to enhance the signals only 
when a target signal is deemed to be present and the 
second filter is operable to perform adaptive filtering 
to suppress the signals only when a target signal is 

25 deemed not to be present . 

According to the invention in a second aspect, there is 
provided: signal processing apparatus comprising: 



1) an array of sensors, each for receiving signals; 

2) means for sampling and digitally converting the 
received signals ; and 

3) a digital processor for processing the digitally 
5 converted signals to provide an output signal, the 

processor having at least one first adaptive filter to 
enhance a desired signal in a reference channel and 
provide undesired signals only in the other channel or 
channels, and a second adaptive filter for calculating 
10 a correlation time delay between signals of the array, 

the processor being operable to calculate a 
reverberation coefficient from the coefficients of the 
first and second filters. 



15 According to the invention in a third aspect, there is 
provided: a method of calculating a spectrum from a coupled 
signal comprising the steps of: 

1) deriving a target signal component S and an 
interference signal component I from the coupled signal; 
20 2 ) transforming the target and interference signal 

components into respective frequency domain equivalents 
F(S) and F(I) ;and 

3) constructing the spectrum P(S) and P(I) of at least 
one equivalent in accordance with: 
25 P(S)=Real ( | F(S) | ) + Imag ( | F(S) | ) + (F(S) *conj (F(S) ) *R(s) 

P (I)=Real ( | F(I) | ) + Imag ( | F ( I ) | ) + ( F (I ) *con j ( F ( I ) ) *R (i) 
Where conj is the complex conjugate, Real and Imag refer 
to taking the absolute value of the real or imaginary 




part of the frequency domain equivalent and R(s), R(i) 
are scalar adjustment factors. 

According to the invention in a fourth aspect, there is 
5 provided: a method of calculating a reverberation coefficient 
from a plurality of signals received from respective sensors 
in respective signal channels of a sensor array comprising 
the steps of: 

1) calculating a correlation time delay between 
10 signals from a reference one of the channels and another 

one of the channels using an adaptive filter; 

2) performing adaptive filtering, using a second 
adaptive filter, on the received signals; and 

3) calculating a reverberation coefficient from the 
15 filter coefficients of the first and second filters. 

The second adaptive filter filters the received signals to 
provide a desired output. In the described embodiment, that 
output is an enhanced target signal and the calculated 
20 reverberation coefficient thus relates to reverberation of 
the target signal. This aspect of the invention may be used, 
however, to calculate the reverberation coefficient of any 
other component of the received signal that the second 
adaptive filter is adapted to provide. 

25 

According to the invention in a fifth aspect, there is 
provided a method of signal processing of a signal having 
wanted and unwanted components comprising the steps of: 
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1) processing the signal in the time domain with at 
least one adaptive filter to enhance the wanted signal 
and/or reduce the unwanted signal, 

2) transforming the thus processed signal to the 
5 frequency domain; and 

3) performing at least one unwanted signal reduction 
process in the frequency domain . 

The invention extends to apparatus for performing the method 
10 of the third to fifth aspects. 

Each aspect of the invention is usable independently of the 
others, for example in other signal processing apparatus 
which need not include other features of this invention as 
15 described. 

The described embodiment of the invention discloses a method 
and apparatus to enhance an observed target signal from a 
predetermined or known direction of arrival. The apparatus 

20 cancels and suppresses the unwanted signals and noise from 
their coupled observation by the apparatus. An approach is 
disclosed to enhance the target signal in a more realistic 
scenario where both the target signal and interference signal 
and noise are coupled in the observed signals. Further, no 

25 assumption is made regarding the number or the direction of 
arrival of the interference signals. 

The described embodiment includes an array of sensors e.g. 



microphones each defining a corresponding signal channel, an 
array of receivers with preamplifiers, an array of analog to 
digital converters for digitally converting observed signals 
and a digital signal processor that processes the signals. 
5 From the observed signals, the apparatus outputs an enhanced 
target signal and reduces the noise and interference signals. 
The apparatus allows a tradeoff between interference and 
noise suppression level and signal quality. No assumptions 
are make about the number of interference signals and the 
10 characteristic of the noise. 

The digital signal processor includes a first set of adaptive 
filters which act as a signal spatial filter using the first 
channel as a reference channel. This filter removes the 

15 target signal "s" from the coupled signal and puts the 
remaining elements of the coupled signal, namely 
interference signals "u" and system noise "q" in an 
interference plus noise channel referred to as a Difference 
Channel. This filter also enhances the target signal "s" and 

20 puts this in another channel, referred to as the Sum Channel. 
The Sum Channel consists of the enhanced target signal "s" 
and the interference signals "u" and noise "q". 

The target signal "s" may not be removed completely from the 
25 Difference Channel due to the sudden movement of the target 
speaker or of an object within the vicinity of the speaker, 
so this channel may contain some residue target signal on 
occasions which can lead to some signal cancellation. 
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However, the described embodiment greatly reduces this. 

The signals from the Difference Channel are fed to a second 
adaptive filter set. This set of filters adaptively estimates 
5 the interference signals and noise in the Sum Channel. 

The estimated signals are fed to an Interference Signal and 
Noise Cancellation and Suppression Processor which cancels 
and suppresses the noise and interference signals from the 
10 Sum Channel and outputs the enhanced target signal. 

Updating of the parameters of the sets of adaptive filters is 
performed using a further processor termed a Preliminary 
Signal Parameters Estimator which receives the observed 
15 signal and estimates the reverberation level of the signal, 
the system noise level, the signal level, estimate signal 
detection thresholds and the angle of arrival of the signal. 
This information is used by the decision processor to decide 
if any parameter update is required. 

20 

One application of the described embodiment of the invention 
is speech enhancement in a car environment where the 
direction of the target signal with respect to the system is 
known. Yet another application is speech input for speech 
25 recognition applications. Again the direction of arrival of 
the signal is known. 




Brief Description of the Drawings 

An embodiment of the invention will now be described by way 
of example with reference to the accompanying drawings in 
5 which : 



Fig.l illustrate a general scenario where the invention may 
be used. 

Fig. 2 is a schematic illustration of a general digital signal 
10 processing system embodying the present invention. 

Fig. 3 is a system level block diagram of the described 
embodiment of Fig. 2. 

Fig. 4a-c is a flow chart illustrating the operation of the 
embodiment of Fig. 3. 
15 Fig 5 illustrates a typical plot of nonlinear energy of a 
channel and the established thresholds. 

Fig. 6 (a) illustrates a wavefront arriving from 40 degree off- 
boresight direction 

Fig 6(b) represents a time delay estimator using an adaptive 
20 filter 

Fig 6(c) shows the impulse response of the filter indicates 
a wave front from the boresight direction. 

Fig 7 illustrates the reverberation level of the received 
signal over time. 
25 Fig 8 shows the schematic block diagram the four channel 
Adaptive Spatial Filter. 

Fig 9 shows the schematic block diagram of the Adaptive 
Interference and Noise Estimator of Fig. 3. 
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Fig 10 shows an input signal buffer. 

Fig 11 shows the use of a Hanning Window on overlapping 
blocks of signals. 

Fig. 12 illustrates a sudden rise of noise level of the 
5 nonlinear energy plot. 

Fig. 13 illustrates the readjustment of the thresholds to 
reflect the sudden rise of noise energy level. 

Detailed Description of the Embodiment of the Invention 

10 

FIG.l illustrates schematically the operating environment of 
a signal processing apparatus 5 of the described embodiment 
of the invention, shown in a simplified example of a room. A 
target sound signal "s" emitted from a source s 1 in a known 

15 direction impinging on a sensor array, such as a microphone 
array 10 of the apparatus 5, is coupled with other unwanted 
signals namely interference signals ul, u2 from other sources 
A,B, reflections of these signals ulr, u2r and the target 
signal ! s own reflected signal sr. These unwanted signals 

20 cause interference and degrade the quality of the target 
signal "s" as received by the sensor array. The actual number 
of unwanted signals depends on the number of sources and room 
geometry but only three reflected (echo) paths and three 
direct paths are illustrated for simplicity of explanation. 

25 The sensor array 10 is connected to processing circuitry 20- 
60 and there will be a noise input q associated with the 
circuitry which further degrades the target signal. 
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An embodiment of signal processing apparatus 5 is shown in 
FIG. 2. The apparatus observes the environment with an array 
of four sensors such as microphones iOa-lOd. Target and 
noise/interference sound signals are coupled when impinging 
5 on each of the sensors. The signals received by each of the 
sensors is amplified by an amplifier 20a-d and converted to 
a digital bitstream using an analogue to digital converter 
30a-d. The bit streams are feed in parallel to the digital 
signal processor 40 to be processed digitally. The processor 
10 provides an output signal to a digital to analogue converter 
50 which is fed to a line amplifier 60 to provide the final 
analogue output. 

FIG. 3 shows the major functional blocks of the digital 
15 processor in more detail. The multiple input coupled signals 
are received by the four-channel microphone array IOa-lOd, 
each of which forms a signal channel, with channel 10a being 
the reference channel. The received signals are passed to a 
receiver front end which provides the functions of amplifiers 
20 20 and analogue to digital converters 30 in a single custom 
chip. The four channel digitized output signals are fed in 
parallel to the digital signal processor 40. The digital 
signal processor 40 comprises four sub-processors. They are 
(a) a Preliminary Signal Parameters Estimator and Decision 
25 Processor 42, (b) a Signal Adaptive Spatial Filter 44, (c) an 
Adaptive Linear Interference and Noise Estimator 46, and (d) 
an Adaptive Interference and Noise Cancellation and 
Suppression Processor 48. The basic signal flow is from 
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processor 42, to processor 44, to processor 46, to processor 
48. These connections being represented by thick arrows in 
Fig. 3. The filtered signal S is output from processor 48. 
Decisions necessary for the operation of the processor 40 are 
5 generally made by processor 42 which receives information 
from processors 44 - 48, makes decisions on the basis of that 
information and sends instructions to processors 44 - 48, 
through connections represented by thin arrows in Fig. 3. 

10 It will be appreciated that the splitting of the processor .40 
into the four component parts 42, 44, 46, 48 is essentially 
notional and is made to assist understanding of the operation 
of the processor. The processor 40 would in reality be 
embodied as a single multi-function digital processor 

15 performing the functions described under control of a program 
with suitable memory and other peripherals. 

A flowchart illustrating the operation of the processors is 
shown in Figs 4a-c and this will firstly be described 
20 generally. A more detailed explanation of aspects of the 
processor operation will then follow. 

The front end 20,30 processes samples of the signals received 
from array 10 at a predetermined sampling frequency, for 
25 example 16kHz. The processor 42 includes an input buffer 43 
that can hold N such samples for each of the four channels. 
Upon initialization, the apparatus collects a block of N/2 
new signal samples for all the channels at step 500, so that 
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the buffer holds a block of N/2 new samples and a block of 
N/2 previous samples. The processor 42 then removes any DC 
from the new samples and preemphasizes or whitens the samples 
at step 502. 

5 

There then follows a short initialization period at step 504 
. in which the first 20 blocks of N/2 samples of signal after 
start-up are used to estimate the environment noise energy E n 
and two detection thresholds, a noise threshold T nl and a 

10 signal threshold T n2 , are calculated by processor 42 from.E n 
using scaling factors. During this short period, an 
assumption is made that no target signals are present. These 
signals do, however, continue to be processed, so that an 
initial Bark Scale system noise value may be derived at step 

15 570, below. 

After this initialisation period, the energies and thresholds 
update automatically as described below. The samples from the 
reference channel 10a are used for this purpose although any 
20 other channel could be used. 

At step 500, with the total non-linear energy of the signal 
samples being calculated at step 506. 

25 At step 508, it is determined if the signal energy E r is 
greater than the signal threshold T rl . If not, the 
environment noise E n and the two thresholds are updated at 
step 510 using the new value of E r calculated in step 506. 
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The Bark Scale system noise B, (see below) is also similarly 
updated via point F. The routine then moves to point B. If 
so, the signal is passed to a threshold adjusting sub-routine 
512-518 . 

5 

Steps 514-518 is used to compensate for abrupt changes in 
environment noise level which may capture the thresholds . A 
time counter is used to determine if the signal level shows 
a steady state increase which would indicate an increase in 

10 noise, since the speech target signal will show considerable 
variation over time and thus can be distinguished. This is 
illustrated in Fig. 12 in which a signal noise level rises 
from an initial level to a new level which exceeds both 
thresholds. At step 512 a time counter C c is incremented. 

15 At step 514 C c is checked against a threshold T cc . If the 
threshold is not reached, the program moves to step 52 0 
described below. If the threshold is reached, the estimated 
noise energy E n is then increased at step 516 by a multiple 
o and E n , T nl and T n2 are updated at step 518. The effect of 

20 this is illustrated in Fig. 13. The counter is reset and 
updating ceases when the the signal energy E r is less than 
the second threshold T n2 as tested at step 520 below. 

A test is made at step 520 to see if the estimated energy E r 
25 in the reference channel 10a exceeds the second threshold T n2 . 
If so, a candidate target signal is deemed to be present. The 
apparatus only wishes to process candidate target signals 
that impinge on the array 10 from a known direction normal to 
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the array, hereinafter referred to as the boresight 
direction, or from a limited angular departure therefrom, in 
this embodiment plus or minus 15 degrees. Therefore the next 
stage is to check for any signal arriving from this 
5 direction. 

At step 524 two coefficients are established, namely a 
correlation coefficient C x and a correlation time delay T d/ 
which together provide an indication of the direction from 
10 which the target signal arrived. 

At step 526, two tests are conducted to determine if the 
candidate target signal is an actual target signal. First, 
the crosscorrelation coefficient C x must exceed a 

15 predetermined threshold T c and, second, the size of the time 
delay coefficient must be less than a value 6 indicating that 
the signal has impinged on the array within the predetermined 
angular range. If these conditions are not met, the signal 
is not regarded as a target signal and the routine passes to 

20 point B. If the conditions are met, the routine passes to 
point A. 

If at step 520, the estimated energy E r in the reference 
channel 10a is found not to exceed the second threshold T n2 , 
25 the target signal is considered not to be present end the 
routine passes to point B via step 522 in which the counter 
C c is reset. This is done since the second threshold at this 
point is above the level of the total signal energy E, 
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indicating that the threshold must be, consequently, above 
the environment noise energy level E, and thus updating of E, 
is no longer necessary. 

5 Thus, the signal has, by points A and B, been preliminarily 
classified into a target signal (point A) or a noise signal 
(point B) . 

Following point A, the signal is subject to a further test at 
10 steps 528-532. At step 528, it is determined if the filter 
coefficients W su of filter 44 have yet been updated. If not, 
the subsequent steps 530, 532 are skipped, since these rely 
on the coefficients of filter 44 for calculation purposes. 
If so, a reverberation coefficient C rv which provides a 
15 measure of the degree of reverberation of the signal is 
calculated and at step 532 it is determined if C rv exceeds a 
threshold T rv If so, this indicates an acceptable level of 
reverberation in the signal and the routine passes to step 
534 (target signal filtering). If not, the signal joins the 
20 path from point B to step 536 (non-target signal filtering) . 

The now confirmed target signal is fed to the Signal Adaptive 
Spatial Filter 44, the purpose of which is to enhance the 
target signal. The filter is instructed to perform adaptive 
25 filtering at steps 534 and 538, in which the filter 
coefficients W su are adapted to provide a "target signal plus 
noise" signal in the reference channel and "noise only" 
signals in the remaining channels using the Leas- Mean Square 
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(LMS) algorithm. The filter 44 output channel equivalent to 
the reference channel is for convenience referred to as the 
Sum Channel and the filter 44 output from the other channels, 
Difference Channels. The signal so processed will be, for 
5 convenience, referred to as A'. 

If the signal is considered to be a noise signal, the routine 
passes to step 536 in which the signals are passed through 
filter 44 without the filter coefficients being adapted, to 
10 form the Sum and Difference channel signals. The signals "so 
processed will be referred to for convenience as B f . 

The effect of the filter 44 is to enhance the signal if this 
is identified as a target signal but not otherwise. 

15 

At step 540, the energy ratio R sd between the Sum Channel and 
the Difference Channel is estimated by processor 42. At step 
542 two tests are made. First, if the signals are A 1 signals 
from step 534, the routine passes to step 550. Second, for 

20 those signals for which E r >T n2 (i.e., high energy level), R sd 
is compared to a threshold T sd . If the ratio is lower than 
T sd , this indicates probable noise but if higher, this may 
indicate that there has been some leakage of the target 
signal into the Difference channel, indicating the presence 

25 of a target signal after all. For such target signals the 
routine also passes to step 550. For all other non-target 
signals, the routine passes to step 544. 
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At steps 544-560, the signals are processed by the Adaptive 
Linear Interference and Noise Estimation Filter 46, the 
purpose of which is to reduce the unwanted signals. The 
filter 46, at step 544 , is instructed to perform adaptive 
5 filtering on the non- target signals with the intention of 
adapting the filter coefficients to reducing the unwanted 
signal in the Sum channel to some small error value E. . 

To further prevent signal cancellation, the norm of the 
10 filter coefficients is calculated by processor 42 at step 
546. If this norm exceeds a predetermined value [T no ] at step 
548, then the filter coefficients are scaled at step 549 to 
a reduced value. 

15 In the alternative, at step 550, the target signals are fed 
to the filter 46 but this time, no adaptive filtering takes 
place, so the Sum and Difference signals pass through the 
filter . 

20 An output of the Sum Channel signal without alteration is 
also passed through the filter 46. 

The output signals from processor 46 are thus the Sum channel 
signal S c (point C) , filtered Difference signals D c (point E) 
25 and an error signal e c (point D) . At step 562, a weighted 
average S ( t ) of the error signal e c and the Sum Channel 
signal is calculated and the signals from the Difference 
channels D c are Summed to form a single signal I (t) . These 
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signals S(t) and I(t) are then collected for the new N/2 
samples and the last N/2 samples from the previous block and 
a Hanning Window H. is applied to the collected samples as 
shown in Fig. 10 to form vectors S h and I h . This is an 
5 overlapping technique with overlapping vectors S r; , I r being 
formed from past and present blocks of N/2 samples 
continuously. This is illustrated in Fig. 11. A Fast Fourier 
Transform is then performed on the vectors S h and I h to 
transform the vectors into frequency domain equivalents S f 
10 and I f , at step 564. 

At step 566 a modified spectrum is calculated for the 
transformed signals to provide "pseudo" spectrum values P s 
and Pi and these values are warped into the same Bark 
15 Frequency Scale to provide Bark Frequency scaled values B s 
and Bi at step 568. 

The Bark value B n of the system noise of the Sum Channel is 
updated at step 570 using B s and the previous value of B n/ if 

20 the condition at step 508 is met (through path F) . At start- 
up, B n is initially calculated at this block whether or not 
the condition is met. At this time, there must be no target 
signal present, thus requiring a short initialization period 
after signal detection has begun, for this initial B r value 

25 to be established. 

A weighted combination By of B n and Bi is then made at step 
572 and this is combined with B s to compute the Bark Scale 
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nonlinear gain G c at step 574. 

G, is then unwarped to the normal frequency domain to provide 
a gain value G at step 578 and this is then used at step 580 
5 to compute an output spectrum S ou , using the signal spectrum 
S, from step 564. This gain-adjusted spectrum, suppresses 
both the interference signals, the environmental noise and 
system noise. 

10 An inverse FFT is then performed on the spectrum S out at step 
582 and the output signal is then reconstructed from the 
overlapping signals using the overlap add procedure at step 
584 . 

15 Major steps in the above described flowchart will now be 
described in more detail. 



# 
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NonLinear Energy and Threshold Estimation and Updating (STEPS 
506, 510) 

The processor 42 estimates the energy output frcn a reference 
5 channel. In the four channel example described, channel 10a 
is used as the reference channel. 

N/2 samples of the digitized signal are buffered into a shift 
register to form a signal vector of the following form: 



10 



*r = 



X(0) 
X(l) 



X(J--I). 



. .A. 1 



Where J = N/2. The size of the vector depends on the 
resolution reguirement. In the preferred embodiment, J=256 
15 samples. The nonlinear energy of the vector is estimated 
using the following eguation: 



i J ' 2 

E r = ~ToJ2 * (i > 2 " X(i-l) A. 2 



When the system is initialized, the average system and 
20 environment noise energy is estimated using the first 20 
blocks of signal. A first order recursive filter is used to 
carry out this task as shown below: . 
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E™ = ai?/ + (l-a)Ef 1 . . .A.3 

Where the superscript K is the block number and 
empirically chosen weight between zero and one. 
5 embodiment, a = 0.9. 

Once the noise energy E n is obtained, the two signal 
detection thresholds Tnl and T n2 are established as follows: 

T n2 = *> 2 E a A. 5 

10 6 X and 8 2 are scalar values that are used to select the 
thresholds so as to optimize signal detection and minimize 
false signal detection. As shown in Fig. 5, T Rl should be 
above the system noise level, with T n2 sufficient to be 
generally breached by the potential target signal. These 

15 thresholds may be found by trial and error. In this 
embodiment, 6,=1.125 and 6 2 =1.8 have been found to give good 
results . 

Once the thresholds have been established, E n may be updated 
20 after initialization in step 513 as follows: 



a is an 
In this 




If E r < T nl 
E n =a n + (l-a)E r 
Else 

En = E„ 

. . .A. 6 

The updated thresholds may then be calculated according to 
equations A. 4 and A. 5. 

Time Delay Estimation (T d ) (STEP 524) 

FIG 6A illustrates a single wave front impinging on the 
sensor array. The wave front impinges on sensor lOd first 
(A as shown) and at a later time impinges on sensor 10a (A 1 
as shown), after a time delay t d . This is because the signal 
originates at an angle of 40 degrees from the boresight 
direction. If the signal originated from the boresight 
direction, the time delay t d will have been zero ideally. 

Time delay estimation of performed using a tapped delay line 
15 time delay estimator included in the processor 42 which is 
shown in Fig. 6B. The filter has a delay element 600 ,having 
a delay Z~ L/2 , connected to the reference channel 10a and a 
tapped delay line filter 610 having a filter coefficient W cd 
connected to channel lOd. Delay element 600 provides a delay 
20 equal to half of that of the tapped delay line filter 610. 
The outputs from the delay element is d(k) and from filter 
610 is d 1 (k) . The Difference of these outputs is taken at 
element 620 providing an error signal e(k) (where k is a time 





index used for ease of illustration) . The error is fed back 
to the filter 610. The Least Mean Squares (LMS) algorithm is 
used to adapt the filter coefficient W. d as follows: 



W cd (k+1) = W cd {k) + 2\iS l0d (k) e(k) B.l 



W ed (k+1) = 



W? d (k+1) 



w£{k+i) 



B.2 



S° od (ic) 
S? od (k) 



B.3 



e(k) = d(k) - d'(k) 



B4 



d'{k) = W cd (k) T .S 10d (k) B.5 



IUW*> 



. . . .B.6 




where p is a user selected convergence factor 0<p<2, || || 
denoted the norm of a vector, k is a time index, L. is the 
filter length. 



5 The impulse response of the tapped delay line filter 620 at 
the end of the adaptation is shown in Fig. 6c. The impulse 
response is measured and the position of the peak or the 
maximum value of the impulse response relative to origin O 
gives the time delay T d between the two sensors which is also 

10 the angle of arrival of the signal. In the case shown, the 
peak lies at the centre indicating that the signal comes from 
the boresight direction (T d =0) . The threshold 6 at step 506 
is selected depending upon the assumed possible degree of 
departure from the boresight direction from which the target 

15 signal might come. In this embodiment, 6 is equivalent to 
± 15°. 



Normalized Cross Correlation Estimation C x (STEP 524) 

20 The normalized crosscorrelation between the reference channel 
10a and the most distant channel lOd is calculated as 
follows : 

Samples of the signals from the reference channel 10a and 
25 channel lOd are buffered into shift registers X and Y where 
X is of length J samples and Y is of length K samples, where 
J>K, to form two independent vectors X r and Y.: 
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X r (l) 
X r (2) 



X r = 



C. 1 



xAJ) 



Y r = 



y r (D 
y r (2) 



y r (*0 



C. 2 



A time delay between the signals is assumed, and to capture 
this Difference, J is made greater than K. The Difference is 
5 selected based on angle of interest. The normalized cross- 
correlation is then calculated as follows: 



CAD = 



Yr * X 



rl 



\Y t \\X xl \ 



. . . C.3 



Where 



X^ = 



XAD 
XAl+l) 



xAK+l-l) 



C.4 



10 Where represents the transpose of the vector and || || 
represent the norm of the vector and 1 is the correlation 
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lag. 1 is selected to span the delay of interest. For a 
sampling frequency of 16kHz and a spacing between sensors 
10a, lOd of 18cm, the lag 1 is selected to be five samples for 
an angle of interest of 15°. 

5 

The threshold T c is determined empirically. T c = 0.85 is used 
in this embodiment. 

Signal Reverberation Estimation C rv (STEP 530) 

10 

The degree of reverberation of the received signal is 
calculated using the time delay estimator filter weight [W td ] 
used in calculation of T d above and the set of spatial filter 
weights [W su ] from filter 44 (described below) as shown in the 
15 following equation: 

^rv • • • • D ■ J- 

T 

Where represents the transpose of the vector and M is the 
channel associated with the filter coefficient W su . In this 
embodiment, three values for C rv , one for each filter 
20 coefficient W su are calculated. The largest is taken for 
subsequent processing. 

The threshold T rv used in step 506 is selected to ensure that 
the signal is selected as a target signal only when the level 
25 of reverberation is moderate, as illustrated in Fig. 7. 




Adaptive Spatial Filter 44 (STEPS 534,536) 



FIG. 8 shows a block diagram of the Adaptive Linear Spatial 
Filter 44. The function of the filter is to separate the 

5 coupled target interference and noise signals into two types. 
The first, in a single output channel termed the Sum Channel, 
is an enhanced target signal having weakened interference and 
noise i.e. signals not from the target signal direction. The 
second, in the remaining channels termed Difference Channels, 

10 which in the four channel case comprise three separate 
outputs, aims to comprise interference and noise signals 
alone. 



The objective is to adapt the filter coefficients of filter 
15 44 in such a way so as to enhanced the target signal and 
output it in the Sum Channel and at the same time eliminate 
the target signal from the coupled signals and output them 
into the Difference Channels. 

20 The adaptive filter elements in filter 44 act as linear 
spatial prediction filters that predict the signal in the 
reference channel whenever the target signal is present. The 
filter stops adapting when the signal is deemed to be absent. 



25 The filter coefficients are updated whenever the conditions 
of steps 504 and 506 are met, namely: 

(i) The adaptive threshold detector detects the presence of 
signal; 




(ii) The time delay estimator indicates that the signal 
arrived from the predetermined angle; 

(iii) The normalized cross correlation of the signal exceeds 
the threshold; and 

5 (iv) The reverberation level is low. 

As illustrate in FIG. 8, the digitized coupled signal X c from 
sensor 10a is fed through a digital delay element 710 of 
delay z~ Lsu/2 . Digitized coupled signals X 1/ X 2/ X 3 from sensors 

10 10b, 10c, lOd are fed to respective filter elements 712,4,6. 
The outputs from elements 710,2,4,6 are Summed at Summing 
element 718, the output from the Summing element 718 being 
divided by four at divider element 719 to form the Sum 
channel output signal. The output from delay element 710 is 

15 also subtracted from the outputs of the filters 712,4,6 at 
respective Difference elements 720,2,4, the output from each 
Difference element forming a respective Difference channel 
output signal, which is also fed back to the respective 
filter 712,4,6, The function of the delay element 710 is to 

20 time align the signal from the reference channel 10a with the 
output from the filters 712,4,6. 

The filter elements 712,4,6 adapt in parallel using the LMS 
algorithm given by Equations E.1..E.8 below, the output of 
25 the Sum Channel being given by equation E.l and the output 
from each Difference Channel being given by equation E.6: 




S c (k) = (S{k) + x 0 (k) )/4 . . .e.i 



M-l 



Where: S(k) = £ S m (k) ...E.2 



/n= 1 



^U) = (W s m u (k)) T X^ik) £.3 



Where m is 0,1,2.. -M-l, the number of channels, in this case 
0..3 and T denotes the transpose of a vector. 



E.4 



*C(*> = 



w? u2 (k) 



E. 5 



Where X m (k) and W su r '(k) are column vectors of dimension L *1 



The weight W 5U ffl (k) is updated using the LMS algorithm as 
10 follows : 
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S cm {k) = X Q {k) - SAk) ...E.6 



fC(Jc + l) = w£(Jc) + 2\x m Xjk) a cm {k) E.l 



and where p is a user selected convergence factor 0<p^2, || || 
5 denoted the norm of a vector and k is a time index. 

Adaptive Interference and Noise Estimation Filter 46 (STEPS 
511,512) 

10 FIG. 9 shows a schematic block diagram of the Adaptive 
Interference and Noise Estimation Filter 46. This filter 
estimates the noise and interference signals and subtracts 
them from the Sum Channel so as to derive an output with 
reduced noise and interference. 

15 

The filter 4 6 takes outputs from the Sum and Difference 
Channels of the filter 44 and feeds the Difference Channel 
Signals in parallel to another set of adaptive filter 
elements 750,2,4 and feeds the Sum Channel signal to a 
20 corresponding delay element 756. The outputs from the three 
filter elements 750,2,4 are subtracted from the output from 
delay element 756 at Difference element 758 to form an error 
output e c , which is also fed back to the filter elements 




750,2,4. The output from filter element 756 is also passed 
directly as an output, as are the outputs from the three 
filter elements 750,2,4. 

5 Again, the Least Mean Square algorithm (LMS) is used to adapt 
the filter coefficients Wuq as follows: 



e c (Jc) = S c (k) - Y^3 cm (k) ...F.l 

m 

Where: B cm (k) = W™(k) T . Y»(k) ... .F2 



Y m (k) = 



3 e3m (k) 



F. 3 



10 



W? g (k+1) = W? g (k) + 2\i m Y n '(k) e c (k) ...F.4 



\Y"\ 



F. 5 



and where P is a user selected convergence factor 0<p<;2 and 
where m is 0,1,2...M-1, the number of channels, in this case 
15 0 . . 3 . 
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Calculation of Energy Ratio R sd (step 540) 
This is performed as follows: 



S e (0) 
S c (l) 



F.6 



D c = 



' a c (o) 




' 4i<o) " 




' 4,(0) 




' 4 5 (o) 


4<d 








4,(1) 




4,(D 








+ 




+ 




a c (j--D 








4 2 (^-D. 







F.7 



J=N/2, the number of samples, in this embodiment 256. 



J- 2 



Esm = ^cO*) 2 - S c (j-1) £ e (j-l) . . . . .F.8 



1^2)% acU)2 " a c<J-D a c <j-l) F.9 



5 Where E SUM is the sum channel energy and E CIF is the difference 
channel energy. 



''SUM 



F. 10 



-'DIF 



The energy ratio between the Sum Channel and Difference 
Channel (R s ,) must not exceed a predetermined threshold. In 
the four channel case illustrated here the threshold is 
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determined to be about 1.5. 

Calculation of Norm of filter coefficients (step 546) 

5 The norms of the coefficients of filters 750,2,4 are also 
constrained to be smaller than a predetermined value. The 
rational for imposing this constraint is because the norm of 
the filter coefficients will be large if a target signal 
leaks into the Difference Channel. Scaling down the norm 

10 value of the filter coefficients will reduce the effect of 
signal cancellation . 

This is calculated as follows: 



If i WKqW > ?no G1 



Then: W u m Q - J^*C nn G.2 



15 Where m is 1,2...M-1, the channels having W uq filters. T n0 is 
a predetermined threshold and C no is a scaling factor, both 
of which can be estimated empirically. 

The output e c from equation F.l is almost interference and 
20 noise free in an ideal situation. However, in a realistic 
situation, this can not be achieved. This will cause signal 
cancellation that degrades the target signal quality or noise 
or interference will feed through and this will lead to 
degradation of the output signal to noise and interference 
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ratio. The signal cancellation problem is reduced in the 
described embodiment by use of the Adaptive Spatial Filter 44 
which reduces the target signal leakage into the Difference 
Channel. However, in cases where the signal to noise and 
5 interference is very high, some target signal may still leak 
into these channels . 

To further reduce the target signal cancellation problem and 
unwanted signal feed through to the output, The output 
10 signals from processor 46 are fed into the Adaptive NonLinear 
Interference and Noise Suppression Processor 48 as described 
below. 

Adaptive NonLinear Interference and Noise Suppression 
15 Processor 48 (STEPS 562-584) 

This processor processes input signals in the frequency 
domain coupled with the well-known overlap add block 
processing technique . 

20 

STEP 562: The output signal (e c ) and the Sum Channel output 
signal (S c ) combined as a weighted average as follows: 



Sit) = W 1 S c (t) + W 2 e c {t) ....H.l 

25 The weights (w 1 ,w 2 ) can be empirically chosen ~o minimize 
signal cancellation or improve unwanted signal suppression. 
In this embodiment, wl=w2=0.5. 




This combined signal is buffered into a memory as illustrated 
in FIG. 10. The buffer consists of N/2 of new samples and N/2 
of old samples from the previous block. Similarly, the 
unwanted signals from the Difference Channel are summed in 
5 accordance with the following and buffered the same way as 
the Sum Channel: 

M-l 

I(t) = Y, D ci . - . 
i=l 



Where: 



<*ci<°> 



d ci (j-i) 



H.2B 
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Where i=l,2...M-l and M is the number of channels, in this 
case M=4 . 

A Hanning Window is then applied to the N samples buffered 
signals as illustrated in FIG. 11 expressed mathematically as 
follows : 



$1 1*2) 



. .H. 3 



15 




Where (HJ is a Harming Window of dimension N, N being the 
dimension of the buffer. The "dot" denotes point by point 
5 multiplication of the vectors, t is a time index. 

Step 5.64: The resultant vectors [S h ] and [I h ] are 

transformed into the frequency domain using Fast Fourier 
Transform algorithm as illustrated in equations H.5 and H.6 
10 below: 

S f = FFT{S h ) . . . .H. 5 
I f = FFT{I h ) 6 

Step 566: A modified spectrum is then calculated, which is 
illustrated in Equations H.7 and H.8: 

P s = Real(\S f \) + Imag{\S f \) + {S f *conj(S f )) *r„ ...H.7 
P s = Real(\l f \) + Imag(\l f \) + ( I f *conj ( I f ) ) *r, ...H.8 



15 Where "Real" and "Ixnag" refer to taking the absolute values 
of the real and imaginary parts, r s and ri are scalars and 
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"Conj" denotes the complex conjugate. 

The values of the scalars (r s and rj control the tradeoff 
between unwanted signal suppression and signal distortion and 
5 may be determined empirically. (r s and rj are calculated as 
l/(2v s ) and l/(2v i ) where v s and v i are scalars. In this 
embodiment, v s =v i is chosen as 8 giving r^r, = 1/256. As 
v sf Vi reduce, the amount of suppression will increase. 

10 Step 568: The Spectra (P s ) and (P^ are warped into (Nb) 
critical bands using the Bark Frequency Scale [see Lawrence 
Rabiner and Bing Hwang Juang, Fundamentals of speech 
recognition, Prentice Hall 1993] . The number of Bark Critical 
bands depend on the sampling frequency used. For a sampling 

15 of 16Khz, there will be Nb = 25 critical bands. The warped 
Pseudo Spectrum of (P s ) and (Pi) are denoted as (B s ) and (BJ . 

Step 570: A Pseudo Spectrum of the system noise and 
environment noise is similarly computed and is denoted as 
20 (B n ) . B n is first establish during system initialization as 
B n =B s and continues to be updated when no target signal is 
detected (step 508) by the system i.e. any silence period. B n 
is updated as follows: 



If E r < T, 



nl 



25 



B n = aB r + (l-a)B s 



Else 



B„ = B. 



H. 9 





Steps 572, 574: Using (B s , B, and B n ) a nonlinear technique is 
used to estimate a gain (G b ) as follows : 

First the unwanted signal Pseudo Spectrum is combined with 
5 the system noise Pseudo Spectrum using an appropriate 
weighting function as illustrate in Equation J.l. 



B y = + Q 2 B n . . . J. l 

Q 1 and Q 2 are weights which can be chosen empirically so as 
10 to maximize unwanted signals and noise suppression with 
minimize signal distortion. 

Follow that a post signal to noise ratio is calculated using 
Equations J. 2 and J. 3 below: 




. . . J . 2 



. . . c7~ . 3 



15 

The division in equation J. 2 means element by element 
division and not vector division. R po and R pp are column 
vectors of dimension Nb*l, Nb being the dimension of the Bark 
Scale Critical Frequency Band and I c is a column unity vector 
20 of dimension Nb*l as shown below: 
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# 



■pod) 

f po(2) 



PO 



J. 4 



-po(N b ) 



r PPd) 
r pp£2) 



pp 



^PPtJVb). 

1 
1 



.J\6 



If any of the r pp (nb) elements of R P? are less than zero, they 
are set equal to zero. 

5 Using the Decision Direct Approach [see Y. Ephraim and D. 
Malah: Speech Enhancement Using Optimal NonLinear Spectrum 
Amplitude Estimation; Proc . IEEE International Conference 
Acoustics Speech and Signal Processing (Boston) 1983, pplll8- 
1121.], the a-priori signal to noise ratio R pr is calculated 

10 as follows : 



Rpr = (1-P;)**pp + Pi 



. .J*. 7 
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The division in Equation J. 7 means element by element 
division. B G is a column vector of dimensions Nb*l and 
denotes the output signal Bark Scale Pseudo Spectrum from 
the previous block B C =G,.B S (see Eqn J. 15) (B c initially is 
5 zero). R pr is also a column vector of dimension Nb*l. The 
value of pi is given in Table 1 below: 



i 


P 


1 


0.01625 


2 


0.01225 


3 


0.245 


4 


0.49 


5 


0.98 



10 



TABLE 1 



15 



The value i is set equal to 1 on the onset of a signal and 
the p value is therefore equal to 0.01625. Then the i value 
will count from 1 to 5 on each new block of N/2 samples 
processed and stay at 5 until the signal is off. The i will 
20 start from 1 again at the next signal onset and the p is 
taken accordingly . 



Instead of p being constant, in this embodiment p is made 
variable and starts at a small value at the onset of the 
25 signal to prevent suppresion of the target signal and 
increases, preferably exponentially, to smooth R_ . 
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From this, R rr is calculated as follows: 



The division in Equation J. 8 is again element by element. R rr 
is a column vector of dimension Nb*l . 

5 

From this, L x is calculated: 



The value of L x is limited to Pi (-3.14) . The multiplication 
in Equation J, 9 means element by element multiplication. L x 
10 is a column vector of dimension Nb*l as shown below: 




rr 



. . . J. 9 



■*x<2> 



l x {nb) 



. . .J. 10 




l x (Nb) 



15 



# 
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A vector L y of dimension Nb*l is then defined as: 



i y (D 
l y {2) 



l y {nb) 



ly(Nb) 



.J. 11 



Where nb = 



l,2...Nb. Then L y is given as 



l y {nb) = exp(*<|£i) ...J-.12 



and 



^(ixb) = -0.57722 - log(l x (nb) ) + - (l x (nb) ) 2 /4 + 

l x (nb) 2 /8 = I x (/i J b) 4 /96. - . 

. . .c7. 13 



10 



E(nb) is truncated to the desired accuracy- 
obtained using a table look-up approach 
computational load . 



L y can be 
to reduce 
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Finally, the Gain G fc is calculated as follows 



G b = R rr -L y . . . J-.14 



The "dot" again implies element by element multiplication, 
G b is a column vector of dimension Nb*l as shown: 



9(1) 
g(2) 



g(nb) 



.9 (Mb). 



. . J. 15 



Step 578: As G t is still in the Bark Frequency Scale, it is 
then unwarped back to the normal linear frequency scale of N 
dimensions. The unwarped G b is denoted as G. 

10 The output spectrum with unwanted signal suppression is given 
as : 



J". 16 



The "dot" again implies element by element multiplication 



15 Step 580: The recovered time domain signal is given by: 



S t = Real (IFFT(S f ) ) . . . J. 17 




IFFT denotes an Inverse Fast Fourier Transform, with only the 
Real part of the inverse transform being taken. 

Step 584: Finally, the output time domain signal is obtained 
5 by overlap add with the previous block of output signal : 





' S t (l) 




' Z e (l) ' 




S e (2) 




Z t (2) 


St = 




+ 






S t (N/2) 




Z c (N/2) 
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Where: 



S t _i(2+N/2) 



J. 19 



The embodiment described is not to be construed as 
limitative. For example, there can be any number of channels 
from two upwards. Furthermore, any novel feature or 
combination of features disclosed is to be taken as forming 
15 an independent invention whether or not specifically claimed 
in the appendant claims of this application as initially 
filed. 




CLAIMS 

1. Signal processing apparatus comprising: 

1) an array of sensors, each for receiving signals; 

5 2) means for sampling and digitally converting the 

received signals; and 

3) a digital processor for processing the digitally 
converted signals to provide an output signal, the 
processor having a first adaptive filter for enhancing 

10 the signals and a second adaptive filter for suppressing 

the signals, the operation of the filters being 
controllable such that the first filter is operable to 
perform adaptive filtering to enhance the signals only 
when a target signal is deemed to be present and the 

15 second filter is operable to perform adaptive filtering 

to suppress the signals only when a target signal is 
deemed not to be present. 

2. Signal processing apparatus comprising: 

20 1) an array of sensors, each for receiving signals; 

2) means for sampling and digitally converting the 
received signals; and 

3) a digital processor for processing the digitally 
converted signals to provide an output signal, the 

25 processor having at least one first adaptive filter to 

enhance a desired signal in a reference channel and 
provide undesired signals only in the other channel or 
channels, and a second adaptive filter for calculating 



a correlation time delay between signals of the array, 
the processor being operable to calculate a 
reverberation coefficient from the coefficients of the 
first and second filters. 

5 

3. A method of calculating a spectrum from a coupled signal 
comprising the steps of: 

1) deriving a target signal component S and an 

interference signal component I from the coupled signal; 
10 2) transforming the target and interference signal 

components into respective frequency domain equivalents 

F(S) and F(I) ;and 

3) constructing the spectrum P(S) and P(I) of at least 
one equivalent in accordance with: 

15 P(S)=Real ( | F(S) | ) + Imag ( | F(S)|) + (F(S) *conj (F(S) ) *R(s) 

P (I) =Real ( | F(I) | ) + Imag ( | F (I ) | ) + (F(I) *conj (F (I) ) *R (i) 
Where conj is the complex conjugate, Real and Imag refer 
to taking the absolute value of the real or imaginary 
part of the frequency domain equivalent and R(s), R(i) 

20 are scalar adjustment factors. 

4. A method of calculating a reverberation coefficient from 
a plurality of signals received from respective sensors in 
respective signal channels of a sensor array comprising the 
25 steps of : 

1) calculating a correlation time delay between 
signals from a reference one of the channels and another 
one of the channels using an adaptive filter; 




48 

2) performing adaptive filtering, using a second 
adaptive filter, on the received signals;and 

3) calculating a reverberation coefficient from the 
filter coefficients of the first and second filters. 

5 

5. A Method of Signal Processing of a signal having wanted 
and unwanted components comprising the steps of: 

1) processing the signal in the time domain with at 
least one adaptive filter to enhance the wanted signal 

10 and /or reduce the unwanted signal , 

2) transforming the thus processed signal to the 
frequency domain; and 

3) performing at least one unwanted signal reduction 
process in the frequency domain. 

15 

6. Apparatus for performing the method of Claim 3 or Claim 
4 . 




ABSTRACT 
SIGNAL PROCESSING APPARATUS 

Signal processing apparatus is disclosed which comprises: 

1) an array of sensors 10, each for receiving signals; 

2) A/D converters 20,30 for sampling and digitally 
converting the received signals/and 

3) a digital processor 40 for processing the digitally 
converted signals to provide an output signal, the 
processor having a first adaptive filter 44 for 
enhancing the signals and a second adaptive filter 46 
for suppressing the signals, the operation of the 
filters being controllable such that the first filter is 
operable to enhance the signals only when a target 
signal is deemed to be present and the second filter is 
operable to suppress the signals only when a target 
signal is deemed not to be present. 

Fig 3. 
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